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Abstract — This paper studies an incentive structure for co- 
operation and its stability in peer-assisted services when there 
exist multiple content providers, using a coalition game theoretic 
approach. We first consider a generalized coalition structure 
consisting of multiple providers with many assisting peers, where 
peers assist providers to reduce the operational cost in content 
distribution. To distribute the profit from cost reduction to 
players (i.e., providers and peers), we then establish a generalized 
formula for individual payoffs when a "Shapley-like" payoff 
mechanism is adopted. We show that the grand coalition is 
unstable, even when the operational cost functions are concave, 
which is in sharp contrast to the recently studied case of a 
single provider where the grand coalition is stable. We also 
show that irrespective of stability of the grand coalition, there 
always exist coalition structures which are not convergent to 
the grand coalition under a dynamic among coalition structures. 
Our results give us an incontestable fact that a provider does not 
tend to cooperate with other providers in peer-assisted services, 
and be separated from them. Three facets of the noncooperative 
(selfish) providers are illustrated; (i) underpaid peers, (ii) service 
monopoly, and (Hi) oscillatory coalition structure. Lastly, we 
propose a stable payoff mechanism which improves fairness of 
profit-sharing by regulating the selfishness of the players as 
well as grants the content providers a limited right of realistic 
bargaining. Our study opens many new questions such as realistic 
and efficient incentive structures and the tradeoffs between 
fairness and individual providers' competition in peer-assisted 
services. 



I. Introduction 



A. Motivation 



The Internet is becoming more content-oriented, and the 
need of cost-effective and scalable distribution of contents has 
become the central role of the Internet. Uncoordinated peer- 
to-peer (P2P) systems, e.g., BitTorrent, have been successful 
in distributing contents, but the rights of the content owners 
are not protected well, and most of the P2P contents are in 
fact illegal. In its response, a new type of service, called 
peer-assisted service, has received significant attention these 
days. In peer-assisted services, users commit a part of their 
resources to assist content providers in content distribution 
with objective of enjoying both scalability/efficiency in P2P 
systems and controllability in client-server systems. Examples 
of application of peer-assisted services include nano data 
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Fig. 1. Two coalition structures for a dual-provider peer-assisted service. 

center [1| and IPTV (2j, where high potential of operational 
cost reduction was observed. For instance, there are now 1.8 
million IPTV subscribers in South Korea, and the financial 
sectors forecast that by 2014 the IPTV subscribers is expected 
to be 106 million Q. However, it is clear that most users will 
not just "donate" their resources to content providers. Thus, 
the key factor to the success of peer-assisted services is how 
to (economically) incentivize users to commit their valuable 
resources and participate in the service. 

One of nice mathematical tools to study incentive- 
compatibility of peer-assisted services is the coalition game 
theory which covers how payoffs should be distributed and 
whether such a payoff scheme can be executed by rational 
individuals or not. In peer-assisted services, the "symbiosis" 
between providers and peers are sustained when (i) the offered 
payoff scheme guarantees fair assessment of players' contri- 
bution under a provider-peer coalition and ( ii) each individual 
has no incentive to exit from the coalition. In the coalition 
game theory, the notions of Shapley value and the core have 
been popularly applied to address (i) and (ii), respectively, 
when the entire players cooperate, referred to as the grand 
coalition. A recent paper by Misra et al. |4| demonstrates that 
the Shapley value approach is a promising payoff mechanism 
to provide right incentives for cooperation in a single-provider 
peer-assisted service. 

However, in practice, the Internet consists of multiple con- 
tent providers, even if only giant providers are counted. In 
the multi-provider setting, users and providers are coupled 
in a more complex manner, thus the model becomes much 
more challenging and even the cooperative game theoretic 
framework itself is unclear, e.g., definition of the worth of a 
coalition. Also, the results and their implications in the multi- 
provider setting may experience drastic changes, compared to 
the single-provider case. 

The grand coalition is expected to be the "best" coalition 



2 



in the peer-assisted service with multiple providers in that it 
provides the highest aggregate payoff. To illustrate, see an 
example in Fig. Q] with two providers (Google TV and iTunes) 
and a large number of peers. Consider two cooperation types: 
(i) separated, where there exists a fixed partition of peers for 
each provider, and ( ii) coalescent, where each peer is possible 
to assist any provider. In the separated case, a candidate payoff 
scheme is based on the Shapley value in each disconnected 
coalition. In the coalescent case, the Shapley value is also a 
candidate payoff scheme after a worth function of the grand 
coalition is defined, where a reasonable worth functional can 
be the total optimal profit, maximized over all combinations of 
peer partitions to each provider. Consequently, the total payoff 
for the coalescent case exceeds that for the separated case, 
unless the two partitions of both cases are equivalent. Shapley 
value is defined by a few agreeable axioms, one of which 
is efficiencJQ, meaning that the every cent of coalition worth 
is distributed to players. Since smaller worth is shared out 
among players in the separated case, at least one individual 
is underpaid as compared with the coalescent case. Thus, 
providers and users are recommended to form the grand 
coalition and be paid off based on the Shapley values. 

However, it is still questionable whether peers are willing to 
stay in the grand coalition and thus the consequent Shapley- 
value based payoff mechanism is desirable in the multi- 
provider setting. In this paper, we anatomize incentive struc- 
tures in peer-assisted services with multiple content providers 
and focus on stability issues from two different angles: stability 
at equilibrium of Shapley value and convergence to the equi- 
librium. We show that the Shapley payoff scheme may lead 
to unstable coalition structure, and propose a different notion 
of payoff distribution scheme, \ value, under which peers and 
providers stay in the stable coalition as well as better fairness 
is guaranteed. 

B. Related Work 

The research on incentive structure in the P2P systems 
(e.g., BitTorrent) has been studied extensively. To incapacitate 
free-riders in P2P systems, who only download contents but 
upload nothing, from behaving selfishly, a number of incentive 
mechanisms suitable for distribution of copy-free contents 
have been proposed (See [5| and references therein), using 
game theoretic approaches. Alternative approaches to exploit 
the potential of the P2P systems for reducing the distribution 
(or operational) costs of the copyrighted contents have been 
recently adopted by H), El. To the best of our knowledge, the 
work by Misra et al. [4| is the first to study the profit-sharing 
mechanism (payoff mechanism) of peer-assisted services. 

Coalition game theory has been applied to model diverse 
networking behaviors, where the main focus in most cases 
(e.g., El) wa s to study the stability of a specific equilibrium 
i.e., the grand coalition in connection with the notion of 
core. Recently, Saad et al. (6), Q, discussed the stability 
and dynamics of endogenous formation of general coalition 
structures. In particular, [7 1 introduced a coalition game model 

'In Section ITITaI we establish that this definition is derived directly from 
an essential property of coalition. 

2 To be discussed formally in Section III-CI 



for self-organizing agents (e.g., unmanned aerial vehicles) col- 
lecting data from arbitrarily located tasks in wireless networks 
and proved the stability of the proposed algorithm by using 
hedonic preference (and dominance). In this paper, we use the 
stability notion by Hart and Kurz |8| (see also (9!|) to study 
the dynamics of coalition structures in peer-assisted services. 
The stability notion in JS) is based on the preferences of any 
arbitrary coalition while the hedonic coalition games are based 
on the preferences of individuals. Other subtle differences are 
described in iflOl . 

C. Main Contributions and Organization 

We summarize our main contributions as follows: 

1) Following the preliminaries in Section [II] in Section (TTTJ we 
describe and propose the cooperative game theoretic frame- 
work of the peer-assisted service with multiple providers. 
After defining a worth function that is provably the unique 
feasible worth function satisfying two essential properties, 
i.e., feasibility and superadditivity of a coalition game, 
we provide a closed-form formula of the Shapley value 
for a general coalition with multiple providers and peers, 
where we take a fluid-limit approximation for mathematical 
tractability. This is a non-trivial generalization of the Shap- 
ley value for the single-provider case in El- In fact, our 
formula in TheoremQ]establishes the general Shapley value 
for distinguished multiple atomic players and infinitesimal 
players in the context of the Aumann-Shapley (A-S) prices 
ifm in coalition game theory. 

2) In Section HVl we discuss in various ways that the Shapley 
payoff regime cannot incentivize rational players to form 
the grand coalition, implying that fair profit-sharing and 
opportunism of players cannot stand together. First, we 
prove that the Shapley value for the multiple-provider 
case is not in the core under mild conditions, e.g., each 
provider's cost function is concave. This is in stark con- 
trast to the single-provider case where the concave cost 
function stabilizes the equilibrium. Second, we study the 
dynamic formation of coalitions in peer-assisted services by 
introducing the notion of stability defined by the seminal 
work of Hart and Kurz [ 8 1 . Finally, we show that, if we 
adopt a Shapley-like payoff mechanism, called Aumann- 
Dreze value, irrespective of stability of the grand coalition, 
there always exist initial states which do not converge to 
the grand coalition. 

3) In Section [VJ we present three examples stating the prob- 
lems of the non-cooperative peer-assisted service: (i) the 
peers are underpaid compared to their Shapley payoffs, ( ii) 
a provider paying the highest dividend to peers monopo- 
lizes all peers, and (Hi) Shapley value for each coalition 
gives rise to an oscillatory behavior of coalition structures. 
These examples suggest that the system with the separated 
providers may be even unstable as well as unfair in a peer- 
assisted service market. 

4) In Section [VI] as a partial solution to the problems of 
Shapley-like payoffs (i.e., Shapley and Aumann-Dreze), 
we propose an alternative payoff scheme, called \ value 
|[T2l . This payoff mechanism is relatively fair in the sense 
that players, at the least, apportion the difference between 
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the coalition worth and the sum of their fair shares, i.e., 
Shapley payoffs, and stabilizes the whole system. It is also 
practical in the sense that providers are granted a limited 
right of bargaining. That is, a provider may award an 
extra bonus to peers by cutting her dividend, competing 
with other providers in a fair way. More importantly, we 
show that authorities can effectively avoid unjust rivalries 
between providers by implementing a simplistic measure. 

After presenting a practical example of peer-assisted ser- 
vices with multiple providers in delay-tolerant networks in 
Section PVIll we conclude this paper. 

II. Preliminaries 

Since this paper investigates a multi-provider case, where a 
peer can choose any provider to assist, we start this section by 
defining a coalition game with a peer partition (i.e., a coalition 
structure) and introducing the payoff mechanism thereof. 

A. Game with Coalition Structure 

A game with coalition structure is a triple (N,v,P) where 
N is a player set and v : 2 N — >• K (2 N is the set of 
all subsets of N) is a worth function, u(0) = 0. v(K) 
is called the worth of a coalition K C N. P is called a 
coalition structure for (N,v); it is a partition of N where 
C(i) £ V denotes the coalition containing player i. For your 
reference, a coalition structure P can be regarded as a set 
of disjoint coalitions. The grand coalition is the partition 
V = {N}. For instance^ a partition of N = {1,2,3,4,5} 
is P = {{1,2}, {3, 4, 5}}, C(4) = {3,4,5}, and the grand 
coalition is P = {{1,2,3,4,5}}. P(S) is the set of all 
partitions of S C N. For notational simplicity, a game without 
coalition structure (N,v, {N}) is denoted by (N,v). A value 
of player i is an operator <j>i(N, v, P) that assigns a payoff to 
player i. We define 4>k = J2ieK & f° r a ^ K C N. 

To conduct the equilibrium analysis of coalition games, the 
notion of core has been extensively used to study the stability 
of grand coalition P — {N}: 

Definition 1 (Core). The core of a game (N, v) is defined by: 
U(N,v) | J2MN,v)=v(N) 

and M N , V ) > v{K),VK C n\. 

If a payoff vector (f>(N, v) lies in the core, no player in N has 
an incentive to split off to form another coalition K because 
the worth of the coalition K, v(K), is no more than the 
payoff sum J^ieK fai^, v). Note that the definition of the 
core hypothesizes that the grand coalition is already formed 
ex-ante. We can see the core as an analog of Nash equilibrium 
from noncooperative games. Precisely speaking, it should be 
viewed as an analog of strong Nash equilibrium where no 
arbitrary coalition of players can create worth which is larger 
than what they receive in the grand coalition. If a payoff vector 
4>{N, v) lies in the core, then the grand coalition is stable with 
respect to any collusion to break the grand coalition. 

3 A player i is an element of a coalition C = C(i), which is in turn an 
element of a partition V. V is an element of V(N) while a subset of 2^. 



B. Shapley Value and Aumann-Dreze Value 

On the premise that the player set is not partitioned, i.e., 
P = {N}, the Shapley value, denoted by <p (not </>), is 
popularly used as a fair distribution of the grand coalition's 
worth to individual players, defined by: 

<Pi(N,v)= (v(SU{i})-v(S)). (1) 

SCJV\{i} 

Shapley [ 1 3 1 gives the following interpretation: "(i) Starting 
with a single member, the coalition adds one player at a time 
until everybody has been admitted, (ii) The order in which 
players are to join is determined by chance, with all arrange- 
ments equally probable. (Hi) Each player, on his admission, 
demands and is promised the amount which his adherence 
contributes to the value of the coalition." The Shapley value 
quantifies the above that is axiomatized (see Section [Tl-Cb and 
has been treated as a worth distribution scheme. The beauty 
of the Shapley value lies in that the payoff "summarizes" in 
one number all the possibilities of each player's contribution 
in every coalition structure. 

Given a coalition structure P ^ {N}, one can obtain 
the Aumann-Dreze value (A-D value) [14| of player i, also 
denoted by ip, by taking C(i), which is the coalition containing 
player i, to be the player set and by computing the Shapley 
value of player i of the reduced game (C(z), v). It is easy to 
see that the A-D value can be construed as a direct extension of 
the Shapley value to a game with coalition structure. Note that 
both Shapley value and A-D value are denoted by ip because 
the only difference is the underlying coalition structure P. 

C. Axiomatic Characterizations of Values 

We provide here an axiomatic characterization of the Shap- 
ley value 02]. 

Axiom 1 (Coalition Efficiency, CE). £ jeC 3 (N, = 
v(C), VC eP. 

Axiom 2 (Coalition Restricted Symmetry, CS). If 

j e C(i) andv(KU{i}) = v(KU{j}) for all K CN\{i,j}, 
then (N, v, P) = 4> 3 (N, v, P). 

Axiom 3 (Additivity, ADD). For all coalition functions v, v' 

andi E N, <j>i(N,v + v' , P) = <f>i{N,v,P) + fa(N,v' ,P). 
Axiom 4 (Null Player, NP). // v(K U {i}) = v(K) for all 
K CN, then <j>i(N,v,P) = 0. 

Recall that the basic premise of the Shapley value is that the 
player set is not partitioned, i.e., P = {N}. It is well-known 
lfl2l . Ifl3l that the Shapley value, defined in (HJ, is uniquely 
characterized by CE, CS, ADD and NP for P = {N}. The 
A-D value is also uniquely characterized by CE, CS, ADD 
and NP (Axioms HUH), but in this case for arbitrary coalition 
structure P HH. In the literature, e.g., 0], HS1, the A-D value 
has been used to analyze the static games where a coalition 
structure is exogenously given. 

Definition 2 (Coalition Independent, CI). If i € C C N, 

C eP andC € V, then <j)i{N,v,P) = <p t (N,v,P'). 

From the definition of the A-D value, the payoff of player 
i in coalition C(i) is affected neither by the player set N nor 
by coalitions C G P, C ^ C(i). Note that only C(i) contains 
the player i. Thus, it is easy to prove that the A-D value is 
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Fig. 2. If a payoff vector lies in the core, the grand coalition is stable |8|. 

coalition independent. From CI of the A-D value, in order to 
decide the payoffs of a game with general coalition structure 
V, it suffices to decide the payoffs of players within each 
coalition, say C S V, without considering other coalitions 
C E V, C ^ C(i). In other words, once we decide the payoffs 
of a coalition C E V, the payoffs remain unchanged even 
though other coalitions, C E V, C ^ C, vary. Thus, for any 
given coalition structure V, any coalition C E V is just two- 
fold in terms of the number of providers in C: (i) one provider 
or (ii) two or more providers, as depicted in Fig. Q] 

Yet another reason why CI attracts our attention is that it 
enables us to define the stability of a game with coalition 
structure in the following simplistic way: 
Definition 3 (Stable Coalition Structure [8|). We say that a 
coalition structure V blocks V, where V 1 , V E V(N), with 
respect to (f> if and only if there exists some C E V' such that 
4>i(N, v, {C, • • • }) > <fii{N, v, V) for all i E C. In this case, 
we also say that C blocks V. If there does not exist any V 
which blocks V, V is called stable. 

Due to CI of the A-D value, all stability notions defined by 
the seminal work of Hart and Kurz [ 8 1 coincide with the above 
simplistic definition, as discussed by Tutic (9). Definition [3] 
can be intuitively interpreted that, if there exists any subset of 
players C who improve their payoffs away from the current 
coalition structure, they will form a new coalition C. In other 
words, if a coalition structure V has any blocking coalition C, 
some rational players will break V to increase their payoffs. 
The basic premise here is that players are not clairvoyant, i.e., 
they are interested only in improving their instant payoffs in 
a myopic way. If a payoff vector lies in the core, the grand 
coalition is stable in the sense of Definition^ but the converse 
is not necessarily true (see Fig. |2). 

D. Comparison with Other Values 

In a particular category of games, called voting games or 
simple games, Banzhaf value as well as the Shapley value 
(also known as Shapley-Shubik index in this context) has been 
used in the literature (See, e.g., [16| and references therein). 
While the Shapley value has been extensively studied in many 
papers, there are no similar results for the Banzhaf value. For 
instance, the Shapley value is proven to lie in the core for 
a special type of games, called convex games, whereas there 
is no equivalent result for the Banzhaf value. Moreover, the 
Banzhaf value violates the efficiency axiom CE in Section 
III-CI for a certain coalition structure V = {N}, leading to 
inefficient sharing of the grand coalition worth. 

As compared with Aumann-Dreze value, a new value, 
referred to as Owen value (See, e.g., tl5\ Chapter 8.8] or ifm 
Chapter XII]) has emerged based on an alternative viewpoint 
on coalition, where a coalition forms not to share the coalition 



worth, but only to maximize their bargaining power with 
regard to division of the worth of the grand coalition. In other 
words, players form a labor union (coalition) to obtain a better 
bargaining position leading to a larger payoff, implying that 
the coalition efficiency axiom CE is also violated. A delicate 
premise of this approach is that players must form the grand 
coalition, the worth of which is in fact the largest worth in 
superadditive games (See Definition |5), and bargain with each 
other at the same time. Also, in the context of P2P systems, 
whether it is more reasonable to nullify CE so that a portion of 
a worth of a coalition (peers and providers) C E V becomes 
transferrable to other coalitions C £ P, C / C, remains an 
open economic question. 

III. Coalition Game in Peer-Assisted Services 

In this section, we first define a coalition game in a peer- 
assisted service with multiple content providers by classifying 
the types of coalition structures as separated, where a coalition 
includes only one provider, and coalescent, where a coalition 
is allowed to include more than one providers (see Fig. [T). To 
define the coalition game, we will define a worth function of 
an arbitrary coalition S G N for such two cases. 

A. Worth Function in Peer-Assisted Services 

Assume that players N are divided into two sets, the set 
of content providers Z := {pi, ■ ■ ■ ,p^}, and the set of peers 
H := {ni, • • • , n v }, i.e., N = ZUH. We also assume that the 
peers are homogeneous, e.g., the same computing powers, disk 
cache sizes, and upload bandwidths. Later, we discuss that our 
results can be readily extended to nonhomogeneous peers. The 
set of peers assisting providers is denoted by H C H where 
x := \H\/r), i.e., the fraction of assisting peers. We define the 
worth of a coalition S to be the amount of cost reduction due 
to cooperative distribution of the contents by the players in S 
in both separated and coalescent cases. 

Separated case: Denote by Q^(x(S)) the operational cost of a 
provider p when the coalition S consists of a single provider p 
and x(S) ■ r\ assisting peers. Since the operational cost cannot 
be negative and may decrease with the number of assisting 
peers, we assume the following to simplify the exposition: 

• Assumption: f2Jj (x) is non-increasing in x for all p E Z. 

Note that from the homogeneity assumption of peers, the cost 
function depends only on the fraction of assisting peers. Then, 
we define the worth function v(S) for a coalition S having a 
single provider as: 

v(S) := fij(0) - Q*(x(S)) (2) 

where f^(0) corresponds to the cost when there are no 
assisting peers. For a coalition S with no provider, we simply 
have v(S) := 0. For notational simplicity, x(S) is henceforth 
denoted by x, unless confusion arises. 

Coalescent case : In contrast to the separated case, where a 
coalition includes a single provider, the worth for the coa- 
lescent case is not clear yet, since depending on which peers 
assist which providers the amount of cost reduction may differ. 
One of reasonable definitions would be the maximum worth 
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out of all peer partitions, i.e., the worth for the coalescent case 
is defined by: for a coalition with at least two providers, 

v(S):=maxi ^fl(C) VeP(S) s.t. \ZnC\ = l, VCeT'i , 
Icev ) 

(3) 

and v(S) := w(S') for a coalition S with at most one 
provider. The definition above implies that we view a coalition 
containing more than one provider as the most productive 
coalition whose worth is maximized by choosing the optimal 
partition V* among all possible partitions of S. Note that (0 
is consistent with the definition (ffj) for \Z D S\ — 1, i.e., 
v(S) =v(S) for \Zr\S\ = 1. 

Five remarks are in order. First, as opposed to [4 1 where 
v({p}) = TjR — ^ip(O) (R is the subscription fee paid by 
any peer), we simply assume that v({p}) = 0. Note that, as 
discussed in |[T5l Chapter 2.2.1], it is no loss of generality 
to assume that, initially, each provider has earned no money. 
In our context, this means that it does not matter how much 
fraction of peers is subscribing to each provider because each 
peer has already paid the subscription fee to providers ex-ante. 

Second, [x) may not be decreasing because, for example, 
electricity expense of the computers and the maintenance cost 
of the hard disks of peers may exceed the cost reduction due 
to peers' assistance in content distribution, e.g., Annualized 
Failure Rate (AFR) of hard disk drives is over 8.6% for three- 
year old ones [ 1 8 1 . 

Third, the worth function in peer-assisted services can re- 
flect the diversity of peers. It is not difficult to extend our result 
to the case where peers belong to distinct classes. For example, 
peers may be distinguished by different upload bandwidths and 
different hard disk cache sizes. A point at issue for the multiple 
provider case is whether peers who are not subscribing to the 
content of a provider may be allowed to assist the provider 
or not. On the assumption that the content is ciphered and 
not decipherable by the peers who do not know its password 
which is given only to the subscribers, providers will allow 
those peers to assist the content distribution. Otherwise, we 
can easily reflect this issue by dividing the peers into a number 
of classes where each class is a set of peers subscribing to a 
certain content. 

Fourth, it should be clearly understood that our worth func- 
tion (0 does not encompass more than just the peer-partition 
optimization. That is, we speculate that cooperation among 
providers might lead to further expenses cut by optimizing 
their network resources. We recognize the lack of this 'added 
bonus' to be the major weakness in our model. 

Lastly, it should be noted that the worth function in (01 
is selected in order to satisfy two properties. First of all, it 
follows from the definition of v in (O that no other coalition 
function v'(-) can be greater than v(-), i.e., v(-) > v'(-) 
because v is the total cost reduction that is maximized over 
all possible peer partitions to each provider. 

Definition 4 (Feasibility). For all worth function v'(-), we 
have v(S) > v'(S) for all S C N. 

The second property, superadditivity, is one of the most 
elementary properties, which ensures that the core is nonempty 



by appealing to Bondareva-Shapley Theorem [15. Theorem 
3.1.4]. 

Definition 5 (Superadditivity). A worth v is superadditive if 
(S,T C N and SnT = 0) v(S U T) > v(S) + v(T). 

The following lemma holds by the fact that a feasible worth 
function cannot be greater than ©, i.e., the largest worth. 
Lemma 1. When the worth for the separated case is given 
by ©, for the coalescent case, there exists a unique worth 
function that is both superadditive and feasible, given by ©. 

Proof: Suppose we have a superadditive worth v'. Firstly, 
it follows directly from the assumption (the worth function 
for the separate case is (f2)) that v'(S) = v{S) if S includes 
one provider, (i) Feasibility: It follows from the definition 
of feasibility that we have v(-) > v'(-) because v(S) is 
the maximum over all possible partitions V G V(S). (ii) 
Superadditivity: In the meantime, since v' is superadditive, 
it must satisfy v'(S U T) > v'(S) + v'{T) for all disjoint S, 
T C N. This in turn implies v'(S) > E CeP w'(C) for all 
V such that V 6 P(S). The right-hand side J2cev v '( C ) 
should coincide with v(S) for some V = V* such that 
\Z n C\ = 1 for all C e V* (See ®), where V* is the 
peer partition which maximizes v(S). Therefore, we have 
v'(S) > v(S). Combining this with v(-) > v'(-) uniquely 
determines v'(-) — v(-). ■ 

In light of this lemma, we can restate that our objective 
in this paper is to analyze the incentive structure of peer- 
assisted services when the worth of coalition is feasible and 
superadditive. This objective in turn implies the form of worth 
function in (0). 

B. Fluid Aumann-Dreze Value for Multi-Provider Coalitions 

So far we have defined the worth of coalitions. Now let 
us distribute the worth to the players for a given coalition 
structure V . Recall that the payoffs of players in a coalition 
are independent from other coalitions by the definition of A- 
D payoff. Pick a coalition C without loss of generality, and 
denote the set of providers in C by Z C Z. With slight 
notational abuse, the set of peers assisting Z is denoted by 
H. Once we find the A-D payoff for a coalition consisting of 
arbitrary provider set Z C Z and assisting peer set H C H, the 
payoffs for the separated and coalescent cases in Fig. [T]follow 
from the substitutions Z = Z and Z — {p}, respectively. In 
light of our discussion in Section III-BI it is more reasonable 
to call a Shapley-like payoff mechanism A-D payoff and 
'Shapley payoff respectively for the partitioned and non- 
partitioned games (JV, v, {ZUH, ■ ■ ■ }) and (N, v, {ZL)H}fi 

Fluid Limit : We adopt the limit axioms for a large population 
of users to overcome the computational hardness of the A-D 
payoffs: 

\im^ oo n;(-)=n p (-) where = ifi^(-) (4) 

which is the asymptotic operational cost per peer in the 
system with a large number of peers. We drop superscript 
rj from notations to denote their limits as 77 — > 00. From the 

4 On the contrary, the term 'Shapley payoff' was used in [4 1 to refer to the 
payoff for the game (TV, v, {Z U H, ■ ■ ■ }) where a proper subset of the peer 
set assists the content distribution. 
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^(x) = n p (0) - Escz\ {p} Jo ^ I5 '(l - u)^-^ (M^ p \ux) - M$(ux)) du, for p G Z (FluidADl) 
^(x) = ~EsczJo ulS Kl-u)^ s ^(ux)du, fomeH. 

j ifii pM (x) = h p (0) - J,, 1 MA4 P ' 9} (Mx)du - / X (1 - u)A4 p} (ux)du + uA4 9} (ua;)du, (p, q are interchangeable) 

1 Vn' q} (x) = - J, 1 ^ 2 dM dx (Mz)dM - E ie {p, g } Jo 1 «(! - w)^-(ua;)dM ! for n G H. 
(FluidAD2 ) 

Fig. 3. Fluid Aumann-Dreze payoff formula for multi-provider coalitions, construed as an extension of Aumann-Shapley prices to multiple atomic players. 



assumption fl^(x) > 0, we have £l p (x) > 0. To avoid trivial 
cases, we also assume fl p (x) is not constant in the interval 
x G [0,1] for any p G Z. We also introduce the payoff of each 
provider per user, defined as tp£ := ^<p p - We now derive the 
fluid limit equations of the payoffs, shown in Fig. [3] which can 
be obtained as r\ — > oo. The proof of the following theorem 
is given in Appendix lAl 

Theorem 1 (A-D Payoff for Multiple Providers). As r/ — > 

oo, the A-D payoffs of providers and peers under an arbitrary 
coalition C = Z U H converge to ( IFluidADTT ) in Fig. \3\ where 

Mi(x) := min{j2ies&i(yi) I EieS^ ^ x > Vi ^ °} and 

M%{x) := 0. Note that fx) = tt p (x). 

The following corollaries are immediate as special cases of 
Theorem Q] which we will use in Section [V] 

Corollary 1 (A-D Payoff for Single Provider). As r\ — > oo, 

the A-D payoffs of providers and peers who belong to a single- 
provider coalition, i.e., Z — {p}, converge to: 

^ p} (x) = n p (0)-J 1 A4 p} (ux)du, 
<fn \x) = - J u d " (ux)du, jorneH. 

Corollary 2 (A-D Payoff for Dual Providers). As rj -> oo, 

the A-D payoffs of providers and peers who belong to a dual- 
provider coalition, i.e., Z = {p, q], converge to ( IFluidAD2l ). 

Note that our A-D payoff formula in Theorem [T]generalizes 
the formula in Misra et al. [4, Theorem 4.3] {i.e., \Z\ = 1). 
It also establishes the A-D values for distinguished multiple 
atomic players (the providers) and infinitesimal players (the 
peers), in the context of the Aumann-Shapley (A-S) prices 
inn in coalition game theory. 

Our formula for the peers is interpreted as follows: Take the 
second line of ( IFluidAD2l ) as an example. Recall the definition 
of the Shapley value (HJ. The payoff of peer n is the marginal 
cost reduction v(S U {n}) — v(S) that is averaged over all 
equally probable arrangements, i.e., the orders of players. It is 
also implied by ([T} that the expectation of the marginal cost 
is computed under the assumption that the events \S\ — y and 
|iS| = y' for y ^ y' are equally probable, i.e., P(\S\ = y) = 
P{\S\ — y 1 ). Therefore, in our context of infinite player game 
in Theorem Q] for every values of ux along the interval [0, x], 
the subset S C ZUff contains ux fraction of the peers. More 
importantly, the probability that each provider is a member of 
S is simply u because the size of peers in S, -qux, is infinite 
as r\ — > oo so that the size of S is not affected by whether 
a provider belongs to S or not. Therefore, the marginal cost 
reduction of each peer on the condition that both providers 

are contained in S becomes — u — § (ux). Likewise, the 

ax ^ ' ' 



marginal cost reduction of each peer on the condition that only 
one provider is in the coalition is — u(l — u) — — (ux). 

IV. Instability of the Grand Coalition 

In this section, we study the stability of the grand coalition 
to see if rational players are willing to form the grand 
coalition, only under which they can be paid their respective 
fair Shapley payoffs. The key message of this section is 
that the rational behavior of the providers makes the Shapley 
value approach unworkable because the major premise of the 
Shapley value, the grand coalition, is not formed in the multi- 
provider games. 

A. Stability of the Grand Coalition 

Guaranteeing the stability of a payoff vector has been 
an important topic in coalition game theory. For the single- 
provider case, \Z\ = 1, it was shown in |4, Theorem 4.2] that, 
if the cost function is decreasing and concave, the Shapley 
incentive structure lies in the core of the game. What if for 
\Z\ > 2? Is the grand coalition stable for the multi-provider 
case? Prior to addressing this question, we first define the 
following: 

Definition 6 (Noncontributing Provider). A provider p e Z 
is called noncontributing if Mq (1) — Afj^^ p ^(l) = Q p (0). 
To understand this better, note that the above expression is 
equivalent to the following: 

^O i (Q)-M|(l)= £ [1,(0) -M™(1) (6) 

iez iez\{ P } 
which implies that there is no difference in the total cost 
reduction, irrespective of whether the provider p is in the 
provider set or not. Interestingly, if all cost functions are 
concave, there exists at least one noncontributing provider. 
Lemma 2. Suppose \Z\ > 2. If Q p (-) is concave for all p G 
Z, there exist \Z\ — 1 noncontributing providers. 
To prove this, recall the definition of Afjf (•): 

M n (x) = mm yeY{x) J2 zeZ ^i(Vi) 

where Y(x) := {(yx,--- ,y\z\) \ Y, ie z l M < x i Vi> °}- 

Since the summation of concave functions is concave and the 
minimum of a concave function over a convex feasible region 
Y(x) is an extreme point of Y(x) as shown in [19, Theorem 
3.4.7], we can see that the solutions of the above minimization 
are the extreme points of {(yi, ■ ■ ■ ,y\ z \) | Y^iezVi < x , Vi> 
0}, which in turn imply yi = for \Z\ — 1 providers in Z. 
Note that the condition \Z\ > 2 is necessary here. 
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We are ready to state the following theorem, a direct 
consequence of Theorem Q] Its proof is in Appendix [B] 
Theorem 2 (Shapley Payoff Not in the Core). // there ex- 
ists a noncontributing provider, the Shapley payoff for the 
game [Z U H, v) does not lie in the core. 

It follows from Lemma [2] that, if all operational cost 
functions are concave and \Z\ > 2, the Shapley payoff does 
not lie in the core. This result appears to be in good agreement 
with our usual intuition. If there is a provider who does not 
contribute to the coalition at all in the sense of © and is 
still being paid due to her potential for imaginary contribution 
assessed by the Shapley formula ([TJ, which is not actually 
exploited in the current coalition, other players may improve 
their payoff sum by expelling the noncontributing provider. 

The condition \ Z\ > 2 plays an essential role in the theorem. 
For \Z\ > 2, the concavity of the cost functions leads to the 
Shapley value not lying in the core, whereas, for the case 
\Z\ = 1, the concavity of the cost function is proven to make 
the Shapley incentive structure lie in the core |4. Theorem 
4.2]. 

B. Convergence to the Grand Coalition 

The notion of the core lends itself to the stability analysis 
of the grand coalition on the assumption that the players are 
already in the equilibrium, i.e., the grand coalition. However, 
Theorem |2] still leaves further questions unanswered. In par- 
ticular, for the non-concave cost functions, it is unclear if the 
Shapley value is not in the core, which is still an open problem. 
We rather argue here that, whether the Shapley value lies in the 
core or not, the grand coalition is unlikely to occur by showing 
that the grand coalition is not a global attractor under some 
conditions. 

To study the convergence of a game with coalition structure 
to the grand coalition, let us recall Definition[3] It is interesting 
that, though the notion of stability was not used in [4], one 
main argument of this work was that the system with one 
provider would converge to a full sharing mode, i.e., the grand 
coalition, hinting the importance of the following convergence 
result with multiple providers. The proof of the following 
theorem is given in Appendix [C] 

Theorem 3 (A-D Payoff Doesn't Lead to Grand Coalition), 

Suppose \Z\ > 2 and £l p (jj) is not constant in the interval 
y G [0,a;] for any p G Z where x = \H\/\H\. The following 
holds for all p G Z and n G H. 



• The A-D payoff of provider p in coalition {p} U H is 
larger than that in all coalition TUH for {p} CTCZ. 

• The A-D payoff of peer n in coalition {p} U H is smaller 
than that in all coalition T U H for {p} C T C Z. 

In plain words, a provider, who is in cooperation with a peer 
set, will receive the highest dividend when she cooperates only 
with the peers excluding other providers whereas each peer 
wants to cooperate with as many as possible providers. It is 
surprising that, for the multiple provider case, i.e., \Z\ > 2, 
each provider benefits from forming a single-provider coalition 
whether the cost function is concave or not. There is no 
positive incentives for providers to cooperate with each other 
under the implementation of A-D payoffs. On the contrary, a 
peer always looses by leaving the grand coalition. 

Upon the condition that each provider begins with a single- 
provider coalition with a sufficiently large number of peers, 
one cannot reach the grand coalition because some single- 
provider coalitions are already stable in the sense of the 
stability in Definition [3] That is, the grand coalition is not 
the global attractor. For instance, take V = {{p} U H, ■ ■ ■ } as 
the current coalition structure where all peers are possessed 
by provider p. Then it follows from Theorem [3] that players 
cannot make any transition from V to {$ U H, ■ ■ ■ } where 
<I> C Z is any superset of {p} because provider p will not 
agree to do so. 

V. Critique of A-D Payoff for Separate Providers 

The discussion so far has focused on the stability of the 
grand coalition. The result in Theorem |2] suggests that if there 
is a noncontributing (free-riding) provider, which is true even 
for concave cost functions for multiple providers, the grand 
coalition will not be formed. The situation is aggravated by 
Theorem [3] stating that single-provider coalitions (i.e., the 
separated case) will persist if providers are rational. We now 
illustrate the weak points of the A-D payoff under the single- 
provider coalitions with three representative examples. 

A. Unfairness and Monopoly 

Example 1 (Unfairness). Suppose that there are two 
providers, i.e., Z = {p, q}, with fl p (x) = 7(x - l) 15 /8 + 1/8 
and Q q (x) = 1 — x, both of which are decreasing and convex. 
All values are shown in Fig. [4] as functions of x. In line with 
Theorem \3\ provider p is paid more than her Shapley value, 
whereas peers are paid less than theirs. 



x 




We can see that each peer n will be paid 21/32 (ip^(0)) 
when he is contained by the coalition {p, n} and the payoff 
decreases with the number of peers in this coalition. On the 
other hand, provider p wants to be assisted by as many peers 
as possible because tfp P ^ (x) is increasing in x. If it is possible 
for n to prevent other peers from joining the coalition, he can 
get 21/32. However, it is more likely in real systems that no 
peer can kick out other peers, as discussed in $\ Section 5.1] 
as well. Thus, p will be assisted by x = 0.6163 fraction of 
peers, which is the unique solution of (pi?^ (x) = (fin^ (x) 



blocked by p t n 



while q will be assisted by 1 



0.3837 fraction of peers. 



Example 2 (Monopoly). Consider a two-provider system 
Z = {p, q} with flp(x) = 1-x 3 / 2 and Q q (x) = l-2x/3, both 
of which are decreasing and concave. Similar to Example\l\ we 
can obtain tp p p} (x) = 2x 3 / 2 /5, <p^ q] ' (x) = x/3, fil p} (x) = 
3a: 1 / 2 /5 and (fffi (x) — 1/3. All values including the Shapley 
values are shown in Fig. \5\ Not to mention unfairness in line 
with Example Q] and Theorem \3\ provider p monopolizes the 
whole peer-assisted services. No provider has an incentive 
to cooperate with other provider. It can be seen that all 
peers will assist provider p because ifn P ^ (x) > {pl?^ (x) 
for x > 25/81. Appealing to Definition \3\ if the providers 
are initially separated, the coalition structure will converge 
to the service monopoly by p. In line with Lemma [2] and 
Theorem [2] even if the grand coalition is supposed to be the 
initial condition, it is not stable in the sense of the core. The 
noncontributing provider (Definition® in this example is q. 



B. Instability of A-D Payoff Mechanism 

The last example illustrates the A-D payoff can even induce 
an analog of the limit cycle in nonlinear systems, i.e., a closed 
trajectory having the property that other trajectories spirals into 
it as time approaches infinity. 

Example 3 (Oscillation). Let us consider a game with two 
providers and two peers where N — {pi,p2, n\, n.2}. If {ni}, 
{712} and {711,712} assist the content distribution of p\, the 
reduction of the distribution cost is respectively 10$, 9$ and 
11$ per month. However, the hard disk maintenance cost 
incurred from a peer is 5$. In the meantime, if {ni}, {112} and 
{711,712} assist the content distribution of P2, the reduction of 
the distribution cost is respectively 6$, 3$ and 13$ per month. 
In this case, the hard disk maintenance cost incurred from a 




blocked by p 2 n,n 2 



blocked by p 

— '"blocked by p l n 1 
Fig. 6. Example f5] A-D Payoff Leads to Oscillatory Coalition Structure. 

peer is supposed to be 2$ due to smaller contents of P2 as 
opposed to those of p\. 

For simplicity, we omit the computation of the A-D payoffs 
for all coalition structures and stability analysis (see Appendix 
of l20l and Table 1 in ll20l for details). We first observe that 
the Shapley payoff of this example does not lie in the core. As 
time tends to infinity, the A-D payoff exhibits an oscillation 
of the partition V consisting of the four recurrent coalition 
structures as shown in Fig. [6] where, for notational simplicity, 
we adopt a simplified expression for coalitional structure V: 
a coalition {a, b,c} € V is denoted by abc and each singleton 
set {i} is denoted by i. The evolution of coalition structure is 
governed by a simple rule: if there exist blocking coalitions 
(See Definition O, then arbitrary one of them will be formed. 

Let us begin with the partition {pi,P2«i^2}- Player p\ 
could have achieved the maximum payoff if he had formed 
a coalition only with ri\. However, player n\ will remain in 
the current coalition because he does not improve away from 
the current coalition. Instead, Player 712 breaks the coalition 
P2ti\n2 so that 712 and p\ can form coalition p\U2 for their 
benefit. As soon as the coalition P2«i^2 is broken, p\ betrays 
712 to increase his payoff by colluding with n\. It is not clear 
how this behavior will be in large-scale systems, as reported 
in the literature J9). 

VI. A Fair, Bargaining, and Stable Payoff 
Mechanism for Peer-Assisted Services 

The key messages from the examples in Section [V] imply 
that the A-D value of the separate case gives rise to unfairness, 
monopoly, and even oscillation. Also, it turns out that some 
players' coalition worth exceeds their Shapley payoffs which 
they are paid in the grand coalition (Theorem |2). Thus, the 
Shapley payoff scheme does not seem to be executable in 
practice because it is impossible to make all players happy, 
unequivocally. That being said, the fairness of profit-sharing 
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Xf (») = 0* (1) + Wj (E je g 0,(0) - Mi(x) - (gff(l) + E je z V? (1))) where< = { J*' |£ { 1 1? 



(FluidChi) 



Fig. 7. Fluid x payoff formula for multi-provider coalitions. 



and the opportunism of players are difficult to stand together. 
Then, it is more reasonable to come up with a compromising 
payoff mechanism that (i) forces players to apportion the 
difference between the coalition worth and the sum of their 
fair shares, (ii) grant providers a limited right of bargaining, 
and ( Hi) stabilize the whole system. We will use a slightly dif- 
ferent notion of payoff mechanism, called \ value, originally 
proposed by Casajus fl2l . 

A. An Axiomatic Characterization of x Value 

The x value is characterized by a similar set of axioms 
used for the A-D value. The only difference is that (i) 
NP is weakened to GNP, causing a deficiency in axiomatic 
characterization, which is made up by WSP: 
Axiom 5 (Grand Coalition Null Player, GNP). If v(K U 
{i}) = v{K)for all K C N, then <j) z (N , v , {N}) = 0. 
Axiom 6 (Weighted Splitting, WSP). If V is finer than V 
(i.e., C'{i) C C(i), Vi G N) and j G V'(i), 

Wi Wj 

The cornerstone of x value is the very observation that, as 
the grand coalition V = {N} is broken into two or more 
coalitions, player i now has another option to ally with other 
coalitions than C(i) G V and this outside option must be 
assessed. To allow the assessment of the outside options, it 
is inevitable to weaken NP (See Section IH-Q to GNP, by 
satisfying only which, a player may receive positive payoff so 
far as he contributes to the worth of the grand coalition, even 
though he does not to that of the current coalition, i.e., NP. 
In the end, it is all about how to valuate the outside option, 
the x value's choice of which is to stick to the Shapley value 
by equally dividing the difference between the coalition worth 
and the sum of Shapley values, i.e., WSP for V = {N}. 

Recalling the definition (Pk(N,v) — YlieK fii-^i v ) m 
Section III- Al we present the following theorem (see [12], ||2T1 
for the proof): 

Theorem 4 (x Value). The x value is uniquely characterized 
by CE, CS, ADD, GNP and WSP as follows: 

Xi (N, v, V) = Vi + = ! (v(C(i)) - <p C (i)) (7) 

where (pi is Shapley value of player i for non-partitioned game 

(N,v) = (N,v,{N}). 

B. Fluid x Value for Multi-Provider Coalitions 

Recall N = ZUH,ZC-Z,H(-H and x — \H\/rj. To 
compute the x payoff for the multiple provider case, we first 
establish in the following theorem^] a fluid x value in line with 
the analysis in Section UlI-BI with the limit axioms: 
Theorem 5 (x Payoff for Multiple Providers). As r\ tends 
to infinity, the x P a y°ff s of providers and peers under an 



arbitrary coalition C = Z U H converge to (IFluidChit in Fig. 
where the Shapley payoffs iff (1) are given in (IFluidADll ) 
in Fig. |2 

To intuitively interpret x value, it is crucial to know the roles 
of Axiom WSP and its weights Wi. In our context, because 
of fairness between peers, it is more reasonable to set wi = 1 
for i G H. It does not make sense to differentiate payoffs 
between peers due to the peer-homogeneity assumption in 
Section IIII-AI On the contrary, we will clarify in Sections 
IVI-CI and IVI-DI why the weights of providers Wi, i G Z do 
not necessarily have to be 1. The essential difference between 
A-D value and x value lies in WSP. 

Interpretation of WSP: It implies that, if peer i loses, say 
Aj, when the coalition structure changes, e.g., from the grand 
coalition V = {N} to a finer coalition structure V' ^ {N}, 
the provider p G C(i) will lose x w p . There are two 
implications of this weighted splitting. First, since the payoff 
of each player i is computed based on the baseline, i.e., the 
Shapley value, and the surplus or deficit incurred by formation 
of the coalition C'(i) are equally distributed for w p = 1, 
X value leads to a fair share of the profit. Secondly, now a 
provider may bargain with peers over the dividend rate by 
setting w p to any positive number. We elaborate on these two 
implications in the following subsections. 

C. Fairness: Surplus-Sharing 

On the basis of the first implication of WSP, x value is 
fairer than A-D value in the following sense: 
Definition 7 (Surplus-Sharing). A value <j) °f game 
(N,v,V) is surplus-sharing if the following condition 
holds: if the coalition worth of coalition C G V is greater 
than, equal to, or less than the sum of Shapley values of 
players in C, i.e., J2 ie c u ' V ) ^ E lG c u )> 
then the payoff of player i G C is greater than, equal to, 
or less than the Shapley value of player i, respectively, i.e., 
cf>i(N, v, V) = Vi{N, v), for all i G C and for all C G V. 

Since we proved in Theorem [3] that, for \Z\ > 2, the payoff 
of provider p in coalition {p} U H exceeds her Shapley value 
and that of peer n G H is smaller than his, it is clear from this 
definition that A-D value is not surplus-sharing for \Z\ > 2, 
whereas x value is surplus-sharing for any Z, e.g., see © and 
(IFluidChib . For reference, both A-D and x values are surplus- 
sharing if \Z\ = 1. 

The corresponding x payoffs of Examples [T] and [2] for Wi = 
1, Vi G Z, are shown in Figs. [8] and [9] As was the case of 
the A-D payoffs in Examples Q] and |2j the grand coalitions 
are not stable. However, due to the surplus-sharing property 

5 In order to compute \ payoff of player i, we need to know not only the 
current coalition C(i) but also Shapley values of players in C(i). However, 
X payoff still satisfies Definition f5] Therefore, we can compute the payoff of 
player i in coalition C(i) irrespective of other coalitions. 
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Fig. 8. Example[T] \ Payoffs of Two Providers and Peers for Convex Cost Fig. 10. Example[T] \ Payoffs of Two Providers and Peers for Convex Cost 
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Fig. 9. Example [2] \ Payoffs of Two Providers and Peers for Concave Cost 
Functions with w p = w q = 1. 

of the x payoff, whenever the coalition worth is larger than 
the Shapley sum of players in the coalition, all players in the 
coalition are paid more and vice versa. For instance, we can 
see from Fig. [8] that if the coalition is formed by provider q 
and x > 0.5625 fraction of peers, all members of the coalition 
are paid more than their respective Shapley payoffs. 

As shown in Fig.|9j the monopoly phenomenon of Example 
12 for the case of A-D payoff is still observed for the case of 
X value. Regarding Example Q] as shown in Fig. [8] x payoff 
even induces the monopoly by q, which did not exist for the 
case of A-D payoff. 

D. Bargaining over the Dividend Rate 

Another implication of WSP is that a provider bargains with 
peers over the division of the profit and loss by setting u>i to 
a nonnegative real value. For instance, consider the case when 
the coalition worth exceeds the Shapley sum of players in the 
coalition, e.g., v(C(p)) > fc{p) m 0> where p 6 Z is the 
only provider in coalition C{p). In this case, a provider may 
award an extra bonus to peers by setting w p < 1, or make 
more profit by setting w p > 1. For the coalition worth smaller 
than the sum of Shapley payoffs, a provider may compensate 
peers for loss by using iv p > 1. Setting w p = 1 guarantees 
the fair profit-sharing between provider p and peers, whereas 
provider p may be willing to use w p ^ 1 for bargaining. 

Although w p can be viewed as a flexible knob to balance the 
fairness of the system and the bargaining powers of providers, 
regulators need to control the providers by introducing upper 
and lower bounds on w p which may depend on whether 
v(C(p)) > fc{p) or not ' because w p have opposite meanings 
for the two cases. For example, providers may use weights 



satisfying the following condition: 

w P > w p , if v(C(p)) < tp C (p), 
< w p < w p , if v(C{p)) > <pc(p)- 
Two bounds, w p and w p can be viewed as a preventive 
measure taken by the authorities to avoid unfair rivalries 
between providers. 

Adopting non-identical weights w p — 0.1 and w q = 3, we 
revisit ExampleQ] Unlike Fig.[8]where provider q monopolizes 
all peers because Xq 9 ^(l) and for i £ H is the 

biggest possible payoffs for q and any peers, the monopoly 
for this set of weights is broken as shown in Fig. [10] Now 
providers p and q will possess 0.6994 and 0.3006 fraction of 
peers, respectively. It is remarkable that the x payoffs are still 
surplus-sharing as in Figs. [8] and [9] 

E. Stability of Coalition Structures 

The x value of the game in Example [3] with equal weights 
Wi = 1, for all i G N, is shown in Table U As discussed in 
[12 1, NP is not suitable for a value reflecting outside options. 
For example, let us consider the partition {P1P2, n>i, "2}- For 
the case of the A-D value, payoffs of both providers p\ and 
P2 are 0. However, as we observe from Example [3] the best 
Pi can do is to ally with ni to reduce her operational cost by 
v({pi, ni}) = 5 whereas the best P2 can do to reduce hers by 
v({p2, ni, TL2}) — 9. In other words, p\ should release P2 so 
that P2 can create her worth because P2 has a worthier outside 
option, to reflect which, x value implementation "punishes" p\ 
by giving her a negative payoff x pi = — 1. 

We also observe from Table Uthat players who can be better 
off by leaving the current coalition are paid more than others. 
For example, consider the partition {piri2,P2,ni}- For the 
case of A-D payoffs, pi and n,2 received the same payoff 2 
(See Table 1 in lEOl ). However, in Table H] 712 is paid more 
than pi because 77,2 has the potential for creating the worthiest 
coalition piP2"-i"2 or P2n\n2, i.e., v(-) = 9. Though 712 will 
not be able to break the partition {pin,2,P2, "1} according 
to the stability defined in Definition [3] 122 is paid more than 
pi essentially for its assessed potential. In this case, the final 
form of coalition structure after its endogenous evolution is 
the state {piri2,P2n>i}- There are now two absorbing states 
{pin,i,p2,ri2} and {pin,2,P2ni}, as shown in Tabled which 
are stable in the sense of Definition [3] On the contrary, there 
does not exist any stable state for the case of A-D payoff as 
shown in Fig. (See also Section IV-Bl and Table 1 in i20l ). 
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TABLE I 

Example[3] x Payoff and Blocking Coalition C 





{piP2,nin 2 \ 


{piP2, ni, n 2 \ 


\pini,p3,ns} 


{pi,P2, nil 12} 


{pini,p 2 iJ2} 


Xpi 


-1 


-1 


5/3=1.67 





5/3=1.67 


\P2 


1 


1 








7/6=1.17 


Xni 


1/2=0.5 





10/3=3.33 





10/3=3.33 


\"2 


-l/2=-0.5 











-l/6=-0.17 


c 


Pi,n2,pini,p2n2,pin2,p2ni 


Pi,pini,pm2,p2ni 




pmi,piri2,P2ni 




P1P2TI! n 2 ,piP2fli ,P1P2U2 

pinin 2 ,P2nin2,piP2nin 2 
1 j ; 


piP2nin2,piP2n 1 ,p 1 p 2 n 2 
pinin2,P2nin2,piP2nin,2 


■ 

' j j ' 


pip 2 111 12 ,PlP27ll ,PlP2ll2 

P2nin 2 ,piP2niri2 
1 ; ; 


h f 




\pip 2 n 2 , n\\ 


; ; 

{Plp2«i, Jl2\ 




|pip 2 ni7i2} 


(pin2,p2.ni| 


Xpi 


A /Q— n A A 


A /Q— O A A 


u 


1 If, — 1 T7 
//D — 1.1/ 


J/J— 1.0 / 


Xl'2 


77/0—7 AA 
ZZ/V— Z.44 


77/Q— AA 
ZZ/V— Z.44 


jZ/7 — J.JD 


1V/D — J.L I 


n 
u 


\"J 





19/9=2.11 


29/9=3.22 


17/6 = 2.83 







10/9=1.11 





20/9=2.22 


11/6 = 1.83 


7/3=2.33 


c 


pini,pip2nin2,P2nin 2 ,pin2 


Pini,p2ni7i2,pin2 


pi7j 2 , pirn 


p\n\,P2n\n2,p\ri2 


p 2 »i 




{pmm2,P2} 


{Pi,p2; nm 2 \ 


{pi,m,p2n2j 


{p\,n2,P2n\\ 


{pi«2,P2Hl} 


Xpi 


-4/9=-0.44 











5/3=1.67 


Xp2 








7/6=1.17 


13/6=2.17 


13/6=2.17 


Xm 


11/9=1.22 


1/2=0.5 





11/6=1.83 


11/6=1.83 


\"2 


2/9=0.22 


-l/2=-0.5 


-l/6=-0.17 





7/3=2.33 


C 


pi,pi»i,pi»2,p2ni, 


n 2 ,pini,p2n2,pin2,p 2 ni 


Pini,pui2,p2ni, 


Pirai,pm2, 




P2JI1 ri2 ,piP2nin 2 


piP2n 1 n2,piP2ni,pip 2 n 2 


pip 2 niTl2,piP2Hi 


piP2nm2,pip 2 n 2 






pipwi.pipznz 


P2n-in2,piP2nin,2 


p 2 ni7i2,piP2n2,ri2 


P2nm2,piP2ni 





A more general result |[T2l Theorem 6.1] is that, if we adopt 
X value to distribute the profit of the peer-assisted services, 
the system always has at least one stable coalition structure, 
irrespective of the number of providers. It it also remarkable 
that the following theorem holds without any restriction on 
operational cost whereas we assumed that O p (-) is non- 

increasing in Section Hn] 

Theorem 6 (Stability of \ Payoff)- For x value, there al- 
ways exists a stable coalition structure V. 

Also, it follows from lfl2l Corollary 6.4] that the instability 
of the grand coalition cannot be improved: 

Corollary 3 (Stability of Grand Coalition Preserved). 

The grand coalition of x value is stable if and only if the 
Shapley value lies in the core. 

To summarize, even if we adopt x value, the instability of 
the grand coalition for the Shapley payoff which we observed 
in Theorem |2] remains unchanged. However, it is guaranteed 
that there exists a stable coalition structure for x value. 

VII. Application to Delay-Tolerant Networks 

In this section, we present a concrete example of the peer- 
assisted services in delay-tolerant networks where mobile 
users share certain contents with each other in a peer-to-peer 
fashion ll22l : whenever two mobile users meet, a user whose 
content is more recent pushes it to the other whose content 
is outdated. We consider here a single class case, using the 
method in \22\. 

We assume that there exist two providers, p and q, whose 
contents differ. Users who are subscribing to the content of a 
provider are assumed to assist the provider in any case. The 
fraction of users subscribing to each provider is denoted by 
Xp and x®. As discussed in Section IIII-AI we also assume 
that a non-subscribing user is allowed to assist at most one 
provider. Suppose that the content providers p and q push 
content updates to users, who are assisting providers, with the 
rate /i p and /i q , respectively, and every user meets other users 
with the aggregate rate A. Then it follows from the analysis in 
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Fig. 1 1 . Cost Functions of Two Providers in the Delay-Tolerant Network. 

[22, Section 5.1] that, if x p > X® fraction of users are assisting 
provider p, for a user who is subscribing to provider p, the 
expected age of the content and the outage probability that the 
age is larger than G™ ax are: 



1 ^ x p^ + Mp 



XpX 



P, 



Mp ' x p \ + Vpe { ^ +x * x)G v^' 

The above two expressions can be easily derived by using 
integration by parts. A provider may guarantee subscribers a 
certain level of quality of service by imposing constraints such 
as (i) G p < lmin or (ii) P p c < 0.01 for G™ ax = lOmin, of 
which we use the former here. 

For instance, the cost function of provider p can be com- 
puted by solving the following optimization problem over // p : 

min^p Xpfip subject to : G p < g p 

where x v [i v corresponds to the average cost per user. The 
solution of this problem yields provider p's cost function: 

h p {x) := xnl = X A — - 

p exp {x\g p ) - 1 

where we dropped the subscript p from x p . Suppose Xp = 
0.4 and x° q = 0.3. If providers p and q use g p = 5/A and 
g q — 10/A, i.e., provider p has decided to maintain a lower 
average age of the content than that of provider q, we get 
the cost functions Vl p (x + Xp)/X and £l q (x + x q )/X as shown 
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in Fig. [TT] By computing the equations in dFluidAD2l ) and 
( IFluidChib . it is not difficult to see that provider p monopolizes 
the remaining fraction of users, 1 — x® — x a q = 0.3, whether 
we adopt the A-D payoff or \ payoff. Nonetheless, users can 
receive more under the \ payoff than under the A-D payoff 
due to the surplus-sharing property discussed in Section IVI-CI 

VIII. Concluding Remarks and Future Work 

A quote from an interview of BBC iPlayer with CNET UK 
M23I : "Some people didn't like their upload bandwidth being 
used. It was clearly a concern for us, and we want to make 
sure that everyone is happy, unequivocally, using iPlayer." 

In this paper, we have first studied the incentive structure 
in peer-assisted services with multiple providers, where the 
popular Shapley value based scheme might be in conflict 
with the pursuit of profits by rational content providers and 
peers. The key messages from our analysis are summarized 
as: First, even though it is fair to pay peers more because 
they become relatively more useful as the number of peer- 
assisted services increases, the content providers will not admit 
that peers should receive their fair shares. The providers tend 
to persist in single-provider coalitions. In the sense of the 
classical stability notion, called 'core', the cooperation would 
have been broken even if we had begun with the grand coali- 
tion as the initial condition. Second, we have illustrated yet 
another problems when we use the Shapley-like incentive for 
the exclusive single-provider coalitions. These results suggest 
that the profit-sharing system, Shapley value, and hence its 
fairness axioms, are not compatible with the selfishness of 
the content providers. We have proposed an alternate, realistic 
incentive structure in peer-assisted services, called \ value, 
which reflects a trade-off between fairness and rationality of 
individuals. Moreover, the weights of \ value can serve as a 
flexible knob to enable providers to bargain with peers over the 
dividend rate at the same time as a preventive measure to avoid 
cutthroat or unfair competition between providers. However, 
we recognize the limitation of these results, which are based 
on the assumption that there is no additional cost reduction 
other than that achieved from the peer-partition optimization. 
We surmise that providers in cooperation can make further 
expenses cut by pooling and optimizing their resources, and 
traffic engineering, which will transform their cost functions. 
The question remains open how the ramifications of this type 
of cooperation can be quantified in peer-assisted services. 
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Appendix 

A. Proof of Theorem Q] 

Recall that we use notation <p z (x) to denote ip(Z U H,v). 
We use the mathematical induction to prove this theorem. The 
equation ( IFluidADU holds for \Z\ = and Z = (empty set) 
because we have from ( IFluidADlT l that there is no provider to 
pay and <^®(x) = for n £ H. 

Now we assume that ( iFluidADlT ) holds for all 5 C Z such 
that |S| < £ where £ > 0. To prove Theorem Q] it suffices 
to show that ( IFluidADlT l also holds for all E' C Z such that 
1 5' | = £ + 1. To this end, we first apply Axiom CE. As rj 
tends to infinity while x remains unchanged, for p £ E' and 
n £ H, Axiom CE for the partition {E'UH} can be rewritten 
as follows: 

E pea < + ^» = Epe- "p(0) " M n>) ( 8 > 
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which is the normalized (which we did in (0) total coalition 
worth created by the coalition S'Uif. Another axiom we apply 
is Axiom FAIR (fairness) which was used by Myerson [24 1 
to characterize the Shapley value. It follows from FAIR that 

!^'(x)-lp^ {p} (x) = ^'(x), for all pes'. (9) 

Summing up (O for all peS' and dividing the sum by |3'| = 
£ + 1, we obtain 

(*) = Ep eH < (^' VW W + (z) 



(10) 



Plugging dTob into ®, we obtain 



:'\M 



(*). 
(11) 

Since we know the form of ifn ^ p ^(x) for all p £ S' from the 
assumption (*,• |E' \ {p}| = £), ( fTTT > is an ordinary differential 
equation of the function 53pep' *?p Denote the RHS of 
(fTTT > by G(.t). Appealing to U Lemma 3], we get 

E p gh' £f fa) = Jo 1 ^G(ux)dw 

= E peS ' «p(0) - Jo + l)A^'(t«:)dti 

~ Jo ""^^Epes' Up} (ux)du, 



^E pes < ^ 



3k E p6S ' (*) = + 1) Jo u^^(ux)du 
pes 

-/o^+^Ep^^^Mdti (12) 
= -(e + l)/o^ +1 ^#(^)du 

+ (f + 1) £ ^ Ep 6S ^ ^ Up} Mdu - E pes - £»' xw - 

(13) 

where the last expression follows by integrating the last term 
of ( [T21 by parts. From (TTOb and ([T3l . 99° (a;) is rearranged as 

<?n{ x ) = - Jo U^ +1 ^-(ux)du 

+ Jo^ +1 E P ez^n X{p} (ux)du. (14) 

From the assumption, Ifn (x) is given by ( [Fluid AD U for 
Z = E' \ {p}, which is plugged into the last term of (TT41 to 
yield 

Jo^ +1 Ep eH ^' X{p} Mdn 

= -]T ]T / 1 /o 1 ( t **) |S| ( u - "*)* _|S| ^^-(«*a:)wd*d«. 
pes'scs'\{p} 

(15) 

To reduce the double integral of (TT5K we use the following 
fact: 

Jo 1 Io( ut ) ]S] ( u " utf-Wf{utx)udtdu 

= Jo Jo T ' 5 ' ( u ~ r)«-l s l/(rx)drdw 

= Jo 1 Jr r ' S| ( w - T)S-\ s \f{Tx)dudr 

= Jo IT^W^t 1 - T)t +1 -Wf(rx)dT (16) 



where we used the change of variable ut — t and changed 
the order of the double integration with respect to u and r. 
Plugging ( fToT l into dT~5b yields 

2'\{P}/ 



r (itx)du 
1 '/o« |S| (i-«) 



1 -i s i^Q-(ux)d« 



Jo EpeH' V« 

E E n 

p6S'SCS'\{p} 

= - ESCEWE' Jo - W )« +1 -' S '^(^)d U . (17) 

where the last equality holds because 

EpeE' EsCE'\{p} f$) '■ EsCE' : S#E' f(S) 

= (e+l)-(|!|):(U| 1 )=e+l-|5|:l. 
Plugging dT7b into ( TT4T > establishes the following desired result: 

0f» = - Esce< Jo « |S| (1 - tij^-^l^^du (18) 
from which it follows 

^'(x)-^ {p} (x) = 
- Esce' Jo " |S| (! - u)^-\S\^f(ux)du 
+ E S cE'\ W /o^ |S| (l-^- |S| ^(^)dn. 

The first term of the RHS can be decomposed into the 
following: 

- E S ce<\m Jo - u^+Mlsi+i) *^ (ua .)d„ 

- EsCE'\{p} Jo (1 - u)^-\^(ux)du. 

Thus, we can obtain 



ffi 0*0 



~3'\M 



E /o 1 

SCE'\{p} 



(*) = 
|s|+i (1 _ u) €-|S| 



Su(p( 



- (ux) 



(19) 



Integrating (O with respect to x and from ([T9l , we get 



E 

SCS'\{p} 



f' 1 

Jo 



1«-|S| 



M, 



SU{p} 



(3/) - Mg(y) 



du. 



Because M^ u{p} (0) - Mjf(O) = ft p (0), the above equation 
combined with ( [T8l finally establishes that ( IFluidADll ) also 
holds for all S' C Z where |H'| = £ + 1, hence completing 
the proof. 



B. Proof of Theorem [2] 

To prove the theorem, we need to show that the condition 
for the core in Definition Q] is violated, implying that it suffices 
to show the following: 

£f(l)>£sM0)--M£(l)-( £ 0,(0) 
iez \j£Z\{p} 

= fi p (0)-(M|(l)-M^ p >(l)). (20) 

This means that the payoff of p G Z is greater than the 
marginal increase of the limit worth, i.e., 

lim^oo U H) - lim^oo \ {p}) U ff). 
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Subtracting the RHS of (TJOjl from the LHS of (|2D) and using 
the expression of <Pp(l) in (IFluidADU . we have 



Mg(l)-M t 



z\{ P } 



(1) 



E /o" |s| d 

SCZ\{p} 



becomes strict when 5 = over some interval in [0, x] whose 
length is positive due to the assumption that £l p (y) is not 
constant in the interval y € [0, x] and non-increasing. From 
this inequality, we have m£ u * p} (j/) - Afgfo) > M< p} (y) and 
)|z 1 II lAl n p ( u ) — Mq(u)J du. the inequality is strict over some interval of positive length. 

Plugging this relation into (1221 yields ipp P ^ (x) — <Pp(%) > 0. 
Note that from ([8j, we have: 



(21) 

We see from Definition |6] that Mjf (1) -M^ {p) {l) = fi p (0). 
From the assumption, there exists a noncontributing provider 
which we denote by p. To show that (f2TT > is strictly positive, 
we rewrite the last factor of the integrand as follows: 

M^(y)-Mi(y) = 

min {E 4e su{ P }^(y 4 ) I E,iesu{p}Vi < v>Vi > 0} 

- min \j2 ie s ^i(Vi) | E ie <? Vi <V,Vi> o} 
where the first term in the RHS can be rearranged as 

min {E iG suM fU(Vi) I Eiesu{p} W < I/.W > °} 

< f2 p (0) + min \j2 ie s &i(Vi) | E lG s J/« <V,Vt> o} 

where the inequality holds from that f2j(y), i £ Z, are non- 
increasing. It can be easily seen that the inequality holds by 
considering two cases y p — and y p > 0. The inequality 
becomes strict when 5 = over some interval in [0, x] whose 
length is positive due to the assumption that f2 p (y) is not 
constant in the interval y G [0, x] and non-increasing. From 
this, we see that (l2"TT i is greater than 

fip(0)- V / 1 U l s l(l-u)l z l- 1 -l' s lf2 p (0)dw = 



SQZ\{p} 



lim„ 



which, when combined with tpp P ^(x) > tpp(x), implies the 
second part of the theorem. 
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which establishes d20l l, hence completing the proof. 



C. Proof of Theorem \3\ 

To prove Theorem [3] it suffices to show that the following 
is positive for {p} C T such that T C Z: 

^\x)-ip T p {x) = -tiMg\ ux) Au 

/rN^ 1 -u)\ T \- l -W (/< U{P} ( M ) - M£(«*)) du 

SQT\{p} 

(22) 

which implies that the payoff of p when it is the only provider 
of the coalition is larger than that with other providers T\{p}. 
To this end, we first observe that, for y < x, 

min {E 4e su{ P }^(y 4 ) I EieSu{p}Vi <V>Vi> °} 

- min [E ie s ttiiVi) | E lS s Vi <V>Vi>^\- 
Here the first term in the RHS can be rearranged as 

min {E lS su{ P } Skim) I E Je su{ P } Vi <y>y*> 0} 

> M^\y) + min [j2 ieS n,( W ) | E, e s Vi < V, Vi > «} 

where the inequality holds from that M^(y), i £ T, are non- 
increasing. It can be easily seen that the inequality holds by 
considering two cases y p — and y p > 0. The inequality 




Yung Yi received his B.S. and the M.S. in the School 
of Computer Science and Engineering from Seoul 
National University, South Korea in 1997 and 1999, 
respectively, and his Ph.D. in the Department of 
Electrical and Computer Engineering at the Univer- 
sity of Texas at Austin in 2006. From 2006 to 2008, 
he was a post-doctoral research associate in the 
Department of Electrical Engineering at Princeton 
University. He is now an associate professor at 
the Department of Electrical Engineering at KAIST, 



South Korea. He has been serving as a TPC member 
at various conferences including ACM Mobihoc, Wicon, WiOpt, IEEE Info- 
com, ICC, Globecom, ITC, and WASA. His academic service also includes 
the local arrangement chair of WiOpt 2009 and CFI 2010, the networking area 
track chair of TENCON 2010, the publication chair of CFI 2011-2012, and 
the symposium chair of a green computing, networking, and communication 
area of ICNC 2012. He has served as a guest editor of the special issue 
on Green Networking and Communication Systems of IEEE Surveys and 
Tutorials, an associate editor of Elsevier Computer Communications Journal, 
and an associate editor of Journal of Communications and Networks. He 
has also served as the co-chair of the Green Multimedia Communication 
Interest Group of the IEEE Multimedia Communication Technical Committee. 
His current research interests include the design and analysis of computer 
networking and wireless systems, especially congestion control, scheduling, 
and interference management, with applications in wireless ad hoc networks, 
broadband access networks, economic aspects of communication networks, 
and greening of network systems. 



